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Detailed Action 

AUDIO AND VIDEO DATA PROCESSING DEVICE FOR MULTIMEDIA 
COMMUNICATION VIA A LOCAL NETWORK SET UP WITHIN AN 
ASYNCHRONOUS NETWORK 

Response to Arguments/Remarks 

1. Claims 1-13 and 15 - 16 are pending in the application. 

2. Applicant arguments of 04/19/2010 after the final action have been fully considered and were 
persuasive. Examiner has re-opened prosecution. 

Double Patenting 

3. A rejection based on double patenting of the "same invention" type finds its support in the 
language of 35 U.S.C. 101 which states that "whoever invents or discovers any new and useful process ... 
may obtain a patent therefor ..." (Emphasis added). Thus, the term "same invention," in this context, 
means an invention drawn to identical subject matter. See Miller v. Eagle Mfg. Co., 151 U.S. 186 (1894); 
In re Ockert, 245 F.2d 467, 1 14 USPQ 330 (CCPA 1957); and In re Vogel, 422 F.2d 438, 164 USPQ 619 
(CCPA 1970). 

4. The nonstatutory double patenting rejection is based on a judicially created doctrine grounded in 
public policy (a policy reflected in the statute) so as to prevent the unjustified or improper timewise 
extension of the "right to exclude" granted by a patent and to prevent possible harassment by multiple 
assignees. A nonstatutory obviousness-type double patenting rejection is appropriate where the 
conflicting claims are not identical, but at least one examined application claim is not patentably distinct 
from the reference claim(s) because the examined application claim is either anticipated by, or would 
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have been obvious over, the reference claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 
(Fed. Cir. 1998); In re Goodman, 1 1 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 
887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In 
re Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 USPQ 
644 (CCPA 1969). 

5. A timely filed terminal disclaimer in compliance with 37 CFR 1 .32 1 (c) or 1 .32 1 (d) may be used 
to overcome an actual or provisional rejection based on a nonstatutory double patenting ground provided 
the conflicting application or patent either is shown to be commonly owned with this application, or 
claims an invention made as a result of activities undertaken within the scope of a joint research 
agreement. 

6. Effective January 1, 1994, a registered attorney or agent of record may sign a terminal disclaimer. 
A terminal disclaimer signed by the assignee must fully comply with 37 CFR 3.73(b). 

7. Application claim 1 is rejected on the ground of nonstatutory obviousness-type double patenting 
as being unpatentable over claims 1 and 4 of U.S. Patent No. 7483523, hereafter '523. Although the 
conflicting claims are not identical, they are not patentably distinct from each other because application 
claim 1 is broader. 

8. With regards to application claim 1, '523 teaches of an Audio and video data processing device 
for multimedia communication, via an asynchronous network with random transmission times, between a 
first pair consisting of a first audio communication terminal and a first video communication terminal, a 
second pair consisting of a second audio communication terminal and a second video communication 
terminal, the said terminals being of the LAN type, where at least the first pair consists of independent 
and asynchronous terminals, and the processing device includes, in association with this first pair, 
connection means for the setting up of: ('523 claim 1 A management apparatus for managing multimedia 
calls set up at least via one of an asynchronous network or a traditional telephone network between a first 
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video communications terminal associated with a first audio communications terminal and a second video 
communications terminal associated with a second audio communications terminal, comprising: 
management means for receiving a request to set up a telephone link between said first and second audio 
communications terminals via said traditional telephone network when the first and second video 
communications terminals request to set up a multimedia link to transmit at least video data via the 
asynchronous network. ) a video link between these connection means and the video terminal of the first 

pair, ('523 Claim 4 read The apparatus according to claim 1, wherein said management means is 

arranged, on receiving the request to set up the telephone link between said first and second audio 
communications terminals: to order said link means to set up the telephone link between said first and 
second audio communications terminals to exchange audio data; and to apply to said audio data 
exchanged via said telephone link a transmission delay to compensate at least in part for a difference in 
transmission duration between said audio data exchanged via said telephone link, and the video data 
exchanged between said first and second video communications terminals via the multimedia link set up 
via said asynchronous network..) 

9. Broader application claim 1 cites an audio and video data processing device for multimedia 
communication but omits the '523 claim 1 citation of one of an asynchronous network or a traditional 
telephone network. 

10. It would have been obvious at the time the invention was made by a person of to having ordinary 
skill in the art to modify the application claim 1 to include one of an asynchronous network or a 
traditional telephone network. 

11. In this manner, the system could be used in an asynchronous network or a traditional 
telephone network. 

Claim Rejections - 35 USC § 112 

12. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 



Application/Control Number: 10/766,842 Page 5 

Art Unit: 2462 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the 
applicant regards as his invention. 

13. Claims 1-13 and 15-16 rejected under 35 U.S.C. 1 12, second paragraph, as being incomplete 
for omitting essential structural cooperative relationships of elements, such omission amounting to a gap 
between the necessary structural connections. See MPEP § 2172.01. 

14. The omitted structural cooperative relationships are: Claim 1 cites 'a video link between these 
connection means'. The Examiner interprets this limitation to claim means-plus-function as in 1 12, sixth 
paragraph. However 'connection means' does not use the term 'means for' e.g. a video link between these 
connection means, an audio link between these connection means etc., See MPEP 2181 (A) first of three 
prong analysis. 

15. In a similar manner, claim 2 cites 'said connection means'. Claim 2 also cites 'their own 
processing means', where 'their own' is indefinite. 

16. Claims 1-13 and 15 - 16 are rejected as they use 'connection means' (claims 1-10) or they are 
directly or indirectly dependent on claim 1. 

Claim Rejections - 35 USC § 103 

17. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

a. A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of 

this title, if the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was made. 

18. Claims 1-7, 10 and 15 - 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Danneels et al (U.S. Patent 5663951), hereafter Danneels, in view of Davies (U.S. Patent 7043749). 

19. In consideration of claim 1, Danneels teaches of an audio and video data processing device for 
multimedia communication across an asynchronous network. (Fig 1; Figure Element (FE) 100, FE 110) 
between a first pair of audio communication terminal (FE 104 and 108) and video communication 
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terminal (FE 102 and 106) and a like second pair (FE 100; Conferencing System B) where the terminals 
are LAN type (4: [0050+]) with connection means for setting up video and audio link of the two pairs 
(Figure 1 ; read analog video and audio, Conferencing System A and B) and video and audio links 
between the two pairs (FE 110 and 4: [0050-0063] Each conferencing system 100 receives, digitizes, and 
compresses the analog video signals generated by camera 1 02 and the analog audio signals generated by 
microphone 104. The compressed digital video and audio signals are transmitted to the other 
conferencing system via network 1 1 0, where they are decompressed and converted for play on monitor 
106 and speaker 108, respectively. In addition, each conferencing system 100 may generate and transmit 
data signals to the other conferencing system 100 for play on monitor 106. The video and data signals are 
displayed in different windows on monitor 106. Each conferencing system 100 may also display the 
locally generated video signals in a separate window). The nature of audio and video signals are typically 
asynchronous, i.e. not synchronous as demonstrated in speech and images, thus the audio and video 
terminals are asynchronous and wherein the connection means synchronizes audio and video data 
according to a delay. (2:[0014] read [a] first subset of the data packets i.e. audio packets, is transmitted 
from the local node to a remote node, and then a subsequent subset of the data packets i.e. video packets, 
is transmitted from the local node to the remote node after a delay to avoid overloading the remote node 
with data packets ) 

20. However Danneels does not explicitly teach of an asynchronous network with random 
transmission times. 

21. By contrast, Ishibashi teaches of a digital network to support multimedia communications that 
preserves the temporal relation among media stream (Section 1, paragraph 1.). Further, Ishibashi teaches 
random transmission times where he contrasts his paper to previous work in the field citing that ".. the 
network delay bounds are not always known." (Section 1, paragraph 4.). 
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22. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the teaching of Danneels with the random transmission times teachings of Ishibashi to form 
a network of asynchronous audio and video media streams with random transmission times. This would 
be advantageous since a network synchronization mechanism based on media streams with random 
transmission times are more realistic in modeling the way packets (or media units) are transported across 
networks. 

23. Danneels and Ishibashi do not disclose where the connection means synchronizes audio and video 
data according to a delay. 

24. Davics teaches where the connection means synchronizes audio and video data according to a 

delay. (15: [0037] read In Step 3 (FIG. 9), synchronised audio and video are sent to the integrated 

terminal. The delay the audio and video signals takes to arrive and be decoded by the integrated terminal 
is time tsub.a 903 and time t.sub.b 904 respectively. As the terminal plays out synchronised audio and 
video time t.sub.b 904 is effectively the same as t.sub.a 903 (within 10.+-.30 ms). At some point the audio 
will contain a marker signal that is looped back 930 to the separate audio device to return it to the 
gateway. The gateway times the audio signal marker between its dispatch and receipt, say time t.sub.3 
901. For the purposes of this measurement it can be assumed that t.sub.x 902 is identical to tsub.x 702 
and 802 and the loop back time of the audio signal is zero) 

25. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the teaching of Danneels with the random transmission times teachings of Ishibashi and the 
delay management teachings of Davies to form a network of asynchronous audio and video media 
streams with random transmission times. This would be advantageous since a network synchronization 
mechanism based on media streams with random transmission times are more realistic in modeling the 
way packets (or media units) are transported across networks. 
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26. In regards to claim 16, Danneels modified teaches the device according to claim 1, wherein the 
video data is transmitted from one of the first video communication terminal and the second video 
communication terminal to a receiving terminal one of the first video communication terminal and the 
second video communication terminal without delay, and the audio data is delayed by a predetermined 
time before being transmitted to a receiving audio communication terminal as the delays between the 
video and audio streams are relative. 

27. With regards to claim 2, Danneels does not teach the device according to claim 1 with first dating 
means arranged to attach a transmit time mark and an identifier to audio and video data; coming from the 
first audio and video communication terminal before their transmission to the second pair via the said 
local network and to attach a receive time mark to the audio and video data coming from the second pair 
and containing an identifier and a transmit time mark, and their own processing means to determine a 
time difference representing the transmission time difference between the received audio and video data 
and presenting the same identifier from their respective transmit and receive time marks to delay by a 
value representing the time difference the transmission of the received audio data at the first audio 
communication terminal in relation to the transmission of the received video data at the first video 
communication terminal. Thus, Danneels does not teach connection means synchronizes audio and video 
data according to a delay. 

28. Ishibashi teaches of a device with first dating means that attaches a transmit time mark and an 
identifier to audio and video (A/V) data before their transmission to the second like A/V terminal pair. 
(Section 2; Media Synchronization model; read data as media unit; transmit time mark as timestamp; 
audio and video data as M media streams I - M, Figure 1) across the local network (Figure 1; read high 
speed network) and attach a receive time mark to the audio and video data from the second pair 
containing an identifier and a transmit time mark. (Section 2; Media Synchronization model; Figure 1 
read destination media stream.). Ishibashi also teaches processing means to determine a time difference 
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representing the transmission time difference between the received audio and video data (Figure 2; read 
'i' as audio or video stream 'i'; sigma as difference between timestamps) and presenting the same 
identifier, i.e. media stream, from their respective transmit and receive time marks i.e. timestamps, and 
delay by a value representing the transmission time difference of the received audio data at the first audio 
communication terminal in relation to the transmission of the received video data at the video 
communication terminal. (Figure 2; also see discussion on page 1011 regarding inter-stream 
synchronization and master/slave streams; Section 1 Introduction, read delay as adjust output timing). 

29. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the teaching of Danneels with the synchronization teachings of Ishibashi. 

30. This modification would be advantageous as it would permit the video and audio packets received 
across an asynchronous network to be synchronized and presented to the end user in concert. 

3 1 . With regards to claims 3-4, and 15, Danneels does not of a device with processing means 
arranged to determine a time difference (ET) representing the transmission time difference and a coding 
and decoding time difference between the received audio and video data, presenting the same identifier 
and synchronization of audio and video occurs once at the connection means and once at the pair. 

32. Ishibashi teaches of media stream coding and decoding performed in the application layer (Figure 
1) that are received at synchronization service access point. Further, Ishibashi teaches of the concept of 
inter-stream synchronization between master/slave streams. (Section 4.2, page 1015) i.e. synchronization 
of audio and video occurs once at the connection means and once at the pair. Because less processing is 
required for audio data, the 'faster' audio stream represents the master stream, the video the slave stream 
i.e. identifier, (page 1011). Danneels teaches that audio (6: [0024]) and video coding and decoding as part 
of the process to generate multimedia streams. 

33. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the teaching of Danneels with the synchronization teachings of Ishibashi. 
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34. This modification would be advantageous as it would further facilitate the video and audio 
packets received across an asynchronous network to be synchronized and presented to the end user in 
concert. 

35. With regards to claims 5 and 7, Danneels teaches of audio and video links that are of a 
"deterministic" type in Figure 1; i.e. links between FE 102,106 and FE100 video; links between FE 
104,108 and FE 100. 

36. In reference to claim 6, Danneels does not teach processing means arranged so as to determine 
the time difference from the transmit and receive time markings of the received audio and video data, and 
from values representing their respective transmission times between the connection means and the first 
audio and video communication terminals for which they are intended. 

37. Ishibashi teaches of media stream coding and decoding performed in the application layer (Figure 
1) that are received at a common synchronization service access point (SSAP). Danneels teaches of audio 
and video links that are of a "deterministic" type in Figure 1 whose delays can be sent to the SSAP. 
Further, Ishibashi teaches that time difference can be derived from time markings i.e. timestamps between 
tightly coupled media-streams such as audio and video (Section 4.2.1 and Figure 4). Further, Ishibashi 
teaches of the concept of inter-stream synchronization between master/slave streams. Because of relative 
shorter period required to process audio data, the audio stream represents the master stream, the video the 
slave stream (Page 1011). 

38. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the teaching of Danneels with the synchronization teachings of Ishibashi. 

39. This modification would be advantageous as it would further facilitate the video and audio 
packets received across an asynchronous network to be synchronized and presented to the end user in 
concert. 
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40. With regard to claim 10, Danneel's Conference System (Figure 1, FE 100) represents a 
connection means that provides a proxy type function for audio and video data to the network LAN. 

41. Claims 8 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Danneels et al 
(U.S. Patent 5663951), hereafter Danneels in view of Ishibashi et al, A Synchronization Mechanism for 
Continuous Media in Multimedia Communication, INFOCOM '95. Fourteenth Annual Joint Conference 
of the IEEE Computer and Communications Societies; Bringing Information to People. Proceedings. 
IEEE 2-6 April 1995 Page(s): 1010 - 1019 vol.3 hereafter Ishibashi, in view of Davies (U.S. Patent 
7043749) and in further view of Little et al, Network and Operating Systems Support for Digital Audio 
and Video: Proceedings, 5th International Workshop on Network and Operating Systems Support for 
Digital Audio and Video, Springer 1995, hereafter Little. 

42. With respect to claims 8-9, Danneels and Ishibashi teach the limitations of claim 2 but are silent 
in teaching assignment of priority levels to audio and video data to be transmitted or assigning a lower 
priority to video data relative to audio data. 

43. By contrast, Little teaches in the traffic characteristics and flow control that video streams have 
lower priority then higher priority audio, i.e. read jitter as characteristic of audio streams. (Page 168 - 169; 
Traffic Characteristics and Flow Control section). 

44. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify inter-stream synchronization between audio and teachings of Danneels and Ishibashi with 
the audio visual (A/V) priority teachings of Little. 

45. By transporting audio streams across a network with a higher priority relative to its companion 
video stream, the random arrival time of A/V packets at the destination port is mitigated and the 
distribution of both packet classes are more tightly bounded. This is ultimately advantageous in 
improving the synchronization of the two data streams. 
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46. Claims 1 1 - 13 are rejected under 35 U.S.C. 103(a) as being unpatentable over Danneels et al 
(U.S. Patent 5663951), hereafter Danneels in view of Ishibashi et al, A Synchronization Mechanism for 
Continuous Media in Multimedia Communication, INFOCOM '95. Fourteenth Annual Joint Conference 
of the IEEE Computer and Communications Societies. Bringing Information to People. Proceedings. 
IEEE 2-6 April 1995 Page(s): 1010 - 1019 vol.3 hereafter Ishibashi, in view of Davies (U.S. Patent 
7043749) and in further view of Keshab et al, Digital Signal Processing for Multimedia Systems, CRC 
Press 1999 pg 245 and 274, hereafter Keshab. 

47. With regards to claim 11-13 Danneels and Ishibashi teach the limitations of claim 1 but are 
silent in teaching of processing device for an audio, video, or communication unit. 

48. Keshab teaches, circa 1999, of recent developments of microprocessors and DSP chips that 
provide audio and video processing capabilities (page 245, 2nd paragraph). Further, Keshab teaches that 
developments of microprocessors can be also be used in wireless communications (page 274, 3rd 
paragraph). 

49. It would have been obvious at the time the invention was made to a person of ordinary skill in the 
art to modify the inter-stream synchronization between audio and teachings of Danneels and Ishibashi 
incorporating a digital processing device in the video, audio, and communication unit. 

50. Processing audio and video signals with a DSP in the video and audio communication unit 
improves the fidelity of A/V data and digital processing of communication signals efficiently utilizes 
bandwidth. 



Conclusion 
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5 1 . Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to HENRY BARON whose telephone number is (571)270-1748. The examiner can normally 
be reached on 7:30 AM to 5:00 PM E.S.T. Monday to Friday. 

52. If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Seema Rao can be reached on (571) 272-3174. The fax phone number for the organization where this 
application or proceeding is assigned is 571-273-8300. 

53. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained 
from either Private PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer 
Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR 
CANADA) or 571-272-1000. 
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